Papers with multi-hop attention
Attention over Heads: A Multi-Hop Attention for Neural Machine Translation (P19-2)
Copied to clipboard
| Challenge: | Existing multihop attentions for machine comprehension are recurrent and hierarchical . a proposed multi-hop attention for the Transformer refines the attention for an output symbol many times . |
| Approach: | They propose a multi-hop attention for the Transformer which integrates attentions from each head. |
| Outcome: | The proposed model outperforms the baseline Transformer in terms of translation accuracy and speed. |
Commonsense and Named Entity Aware Knowledge Grounded Dialogue Generation (2022.naacl-main)
Copied to clipboard
| Challenge: | Empirical results show that our proposed model outperforms the state-of-the-art methods in terms of both automatic evaluation metrics and human judgment. |
| Approach: | They propose a model which uses large-scale commonsense and named entity based knowledge to ground dialogue on external knowledge and topic-specific knowledge associated with each utterance. |
| Outcome: | The proposed model outperforms the state-of-the-art methods on two benchmark datasets. |